Hands-free asset identification, location and management system

ABSTRACT

A hands-free asset management system and a method of its operation are disclosed. An example system includes an asset tracking database storing an asset location and one or more identifying characteristics of each of a plurality of networking assets, and an application executable on a wearable display device communicatively connected to the asset tracking database. The application is executable to receive a work order associated with at least one asset among the plurality of networking assets, based on a location of the wearable display device and the work order, display one or more directions to the asset for a wearer of the wearable display device, and display one or more work instructions to be performed on the asset.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is being filed on May 7, 2015, as a PCT InternationalPatent application and claims priority to U.S. Patent Application Ser.No. 61/989,938 filed on May 7, 2014, the disclosure of which isincorporated herein by reference in its entirety.

TECHNOLOGICAL FIELD

The present disclosure relates generally to a system for determininglocations of network assets, such as network connections. In particular,the present disclosure relates to a hands-free asset identification,location, and management system.

BACKGROUND

Large-scale networks and facilities typically include assets of avariety of types which are placed at a variety of locations. Forexample, a network that is maintained by a telecommunications provideror facility may include networking equipment, such as patch panels,routers, or other networking equipment, in a single rack, in differentracks, and across different rooms, buildings, or other locations. Eachof these network assets may in turn also include other assets, such asavailable or occupied network jacks or other network connections usableto route signals among network devices.

Often, a technician is required to service network assets, for exampleby configuring network connections at a field location. Often, thatservicing requires the technician to disconnect and reconnect networkingcables, or to otherwise locate, identify and service specific networkjack locations or other network assets. When a technician modifies aconfiguration of equipment (e.g., patch panels) in data centers orsplitter nodes in outside environments, it is important to ensure thatthe technician has located the correct piece of equipment. If thetechnician identifies the wrong asset for configuration, or does notknow how to modify the asset as needed, costly mistakes can happen.

Currently, technicians are required to rely on labeling of networkassets, and must correlate those networking locations to changenetworking configurations, or to otherwise service network assets. Whenrelying on such labeling, it is not uncommon for the technician toincorrectly configure network assets, for example by inserting a pluginto the incorrect jack of a patch panel, thereby providing erroneousrouting, and resulting in such costly mistakes.

In other types of facilities or circumstances where locations ofcomponents of a system are generally constant but of a high number,similar challenges apply. For example, when servicing a vehicle or othertypes of electronic or mechanical equipment having a large number ofpossible components that are required to be accessed and adjusted, itcan be difficult to determine which components are interconnected, andwhat electrical components (e.g., fuses, breakers, etc.) are associatedwith different electrical and/or mechanical subsystems.

Still further difficulties exist in assessing and locating assets, inparticular because in many cases maps or networking diagrams arerequired, which involve cross-referencing paper or electronic diagramsto real-world asset locations. This typically complicates the locationand maintenance process, both because of the cross-referencing requiredand the fact that a technician's hands are typically occupied withmaintenance services. Still further, identification and location of suchassets, particularly those kept indoors at networking facilities, can bedifficult absent such physical or electronic diagrams, since typically alarge number of networking or computing assets are housed in a commonlocation (and are difficult to distinguish from one another).

Accordingly, improvements in tracking of assets, including racks,panels, and even networking connections are desirable.

SUMMARY

In accordance with the following disclosure, the above and other issuesare addressed by the following:

In a first aspect, a hands-free asset management system is disclosed. Anexample system includes an asset tracking database storing an assetlocation and one or more identifying characteristics of each of aplurality of networking assets, and an application executable on awearable display device communicatively connected to the asset trackingdatabase. The application is executable to receive a work orderassociated with at least one asset among the plurality of networkingassets, based on a location of the wearable display device and the workorder, display one or more directions to the asset for a wearer of thewearable display device, and display one or more work instructions to beperformed on the asset.

In a second aspect, a method of tracking networking assets includesreceiving, at an application executing on a wearable display device, awork order associated with at least one asset among a plurality ofnetworking assets stored in an asset tracking database, each of aplurality of records associated with the plurality of networking assetsincluding an asset location and one or more identifying characteristicsof that asset. The method also includes, based on a location of thewearable display device and the work order, displaying one or moredirections to the asset for a wearer of the wearable display device. Themethod further includes displaying one or more work instructions to beperformed on the asset based on the work order.

In a third aspect, an application installable on a wearable displaydevice for execution to manage networking assets, the applicationincluding a plurality of executable instructions stored in a memory ofthe wearable display device. When executed, the instructions cause thewearable display device to perform a method including receiving a workorder associated with at least one asset among a plurality of networkingassets stored in an asset tracking database, each of a plurality ofrecords associated with the plurality of networking assets including anasset location and one or more identifying characteristics of thatasset, based on a location of the wearable display device and the workorder, displaying one or more directions to the asset for a wearer ofthe wearable display device, and displaying one or more workinstructions to be performed on the asset based on the work order.

In a further aspect, an asset location system includes a mobileapplication component executable on a mobile device including a cameraand a display, the mobile application component configured to receiveimage data from the camera and display an image on the display based onthe image data and overlay information identifying one or more assetsidentifiable in the image data. The asset location system also includesan asset management tracking engine configured to receive the image dataand generate the overlay information including an identification of alocation of at least one of the one or more assets within the image.

In a further aspect, a network asset location system includes a mobileapplication component executable on a mobile device including a cameraand a display. The mobile application component is configured to receiveimage data from the camera and display an image on the displayidentifying one or more network assets identifiable in the image data.The network asset location system includes a plurality of identifiersassociated with the one or more network assets each positioned at aknown location relative each of the plurality of identifiers. Thenetwork asset location system also includes an asset management trackingengine configured to receive the image data and generate the overlayinformation including an identification of a location of at least one ofthe one or more network assets within the image.

In a further aspect, a method of determining an asset location using anapplication executing on a mobile device having a camera and a displayis disclosed. The method includes capturing image data of a networkasset using the camera of the mobile device, the image data includinginformation regarding a plurality of identifiers associated with thenetwork asset and positioned at a predetermined location relative to thenetwork asset. The method also includes displaying an image includingoverlay information identifying the network asset and a location of thenetwork asset within the image.

In a further aspect, a method of determining an asset location using anetwork asset management engine is disclosed. The method includesreceiving image data including image data relating to a network asset,the image data also including information regarding a plurality ofidentifiers associated with the network asset and positioned at apredetermined location relative to the network asset. The method alsoincludes determining an identity of the network asset based at least inpart on recognition of the plurality of identifiers and a relativeposition of the network asset relative to the plurality of identifiersin the image data. The method further includes generating overlayinformation identifying a location and an identity of the network assetin the image data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example network asset location system used inconjunction with a distributed networking system in which aspects of thenetwork asset location system of the present disclosure can beimplemented;

FIG. 2 illustrates an example logical block diagram of a network assettracking engine usable within a network asset location system, accordingto a possible embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating an example arrangement fortracking network assets, according to a possible embodiment of thepresent disclosure;

FIG. 4 is a schematic diagram illustrating an example display on amobile device illustrating the tracked network asset, according to apossible embodiment of the present disclosure;

FIG. 5 is a schematic diagram illustrating an example display on amobile device illustrating the tracked network asset and an overlayprovided based on identification of the tracked network asset, accordingto a possible embodiment of the present disclosure;

FIG. 6 is a schematic diagram illustrating an example display on amobile device illustrating the tracked network asset and an overlay thatprovides asset identification information displayable to a user,according to a possible embodiment of the present disclosure;

FIG. 7 is a schematic diagram illustrating an example display on amobile device illustrating asset detail information displayable to auser, according to a possible embodiment of the present disclosure;

FIG. 8 is a schematic diagram illustrating an example arrangement fortracking network assets, according to a second possible embodiment ofthe present disclosure;

FIG. 9 is a flowchart of methods and systems for tracking network assetsusing a mobile device, according to a possible embodiment of the presentdisclosure;

FIG. 10 is a flowchart of methods and systems for tracking networkassets using a mobile device and/or a network assert tracking engine anddatabase remote from the mobile device, according to a further possibleembodiment of the present disclosure;

FIG. 11 is a schematic diagram illustrating an example arrangement forhands-free management of network assets using a wearable display device,according to a possible embodiment of the present disclosure;

FIG. 12 is a schematic diagram illustrating an example locating processfor a wearable display device within a facility, according to aspects ofthe present disclosure;

FIG. 13 is a schematic diagram illustrating an example locating processfor a wearable display device outside of a facility, according toaspects of the present disclosure;

FIG. 14A illustrates an example direction service provided by anapplication executing on a wearable display device, according to anexample embodiment of the present disclosure;

FIG. 14B illustrates an example video chat provided by an applicationexecuting on a wearable display device, according to an exampleembodiment of the present disclosure;

FIG. 15 is a schematic diagram illustrating an example assetidentification process using a wearable display device, according toaspects of the present disclosure;

FIG. 16 illustrates an example work instruction included in a work orderreceived at a wearable display device according to example aspects ofthe present disclosure; and

FIG. 17 is a flowchart of an example method of tracking networkingassets in a hands-free manner using a wearable display device, accordingto an example embodiment of the present disclosure.

DETAILED DESCRIPTION

Various embodiments of the present invention will be described in detailwith reference to the drawings, wherein like reference numeralsrepresent like parts and assemblies throughout the several views.Reference to various embodiments does not limit the scope of theinvention, which is limited only by the scope of the claims attachedhereto. Additionally, any examples set forth in this specification arenot intended to be limiting; and merely set forth some of the manypossible embodiments for the claimed invention.

In general, the present disclosure relates to a network assetidentification, location, and management system that can be used toidentify assets to a technician user, and provide direction as to theirinterconnection, location, and maintenance. In certain embodiments, thepresent disclosure describes an application operating on a mobile devicehaving a camera and a display, and can capture image information (e.g.video information), and overlay an identification of a particular assetof interest on that video data when displayed on the display. Forexample, if the asset of interest is a network asset, the overlayinformation could be used to identify to the technician a correctnetwork asset (e.g., a network jack or other connectivity element,panel, or portion of a panel, network switch, subrack, network blade orrack) to be serviced. In other embodiments, any of a variety ofdifferent electrical or mechanical systems could be identified. In someembodiments, that user can see this overlay information using arealtime, overlay-augmented display.

In various embodiments discussed herein, the mobile device used topresent overlay information can be a mobile computing device or awearable display device. Accordingly, the overlay can correspond toeither addition of supplemental information to a display of previouslycaptured information (e.g., as would be presented on a display of atablet or smartphone) or could alternatively correspond to projection ofsupplemental information onto a semitransparent display, such that theprojected supplemental information is viewed in conjunction withbackground scenes (e.g., via a “heads up display” or other type ofdisplay.

Referring now to FIG. 1, an example network asset location system 100used in conjunction with a distributed networking system is shown, inwhich aspects of the network asset location system of the presentdisclosure can be implemented. The network asset location system 100 caninclude, in the embodiment shown a mobile device 102 on which a mobileapplication component resides, and which can execute the mobileapplication component. The mobile device 102 can be, in variousembodiments, any mobile device including a camera 103 and a display 104,such as a smartphone or tablet computing system. The mobile applicationcomponent includes program instructions executable on the mobile device102, and is configured to receive image data from the camera 103 anddisplay an image on the display 104 of the captured image.

In the embodiment shown, the mobile device 102 can be used at a networkasset facility 105, which is generally a location where networkingequipment is stored. In the embodiment shown, the network asset facility105 can be a data center or other outside plant application, and caninclude a plurality of pieces of networking equipment 106, which can, invarious applications, include patch panels, data center racks, servers,or other networking equipment. In the context of the present disclosure,any piece of networking equipment or access point provided by suchequipment (e.g., telecommunications jacks made available on such patchpanels or routers, fiber optic connections, or other physical networkaccess connections) are considered “network assets” which can beconfigured and provide network data access to subscriber endpoints in adata network.

In the embodiment shown, a plurality of patch panels 106 a-c are shown,each of which has a plurality of telecommunications jacks. In accordancewith the present disclosure, each of the patch panels 106 a-c, or eachtelecommunications jack, or both, could correspond to a network asset.The patch panels are, in the embodiment shown, included within anoverall network 107, which is the network administered and maintained bythe technician using the network asset location system 100 of thepresent disclosure.

In certain embodiments, and as discussed in further detail below inconnection with FIGS. 3-8, groups of assets (e.g., patch panels within aparticular rack or other device) can be associated with a plurality ofidentifiers, such that locations of assets that may be difficult tocorrectly identify (e.g., telecommunications jacks) can be located bytriangulation or other relative location calculation procedures. Inparticular embodiments, the various network assets can include, forexample, managed patch panels, such as are described in U.S. ProvisionalPatent Application No. 61/706,460, filed on Sep. 27, 2012, and entitled“Mobile Application for Assisting a Technician in Carrying Out anElectronic Work Order”, and U.S. patent application Ser. No. 13/775,798,filed on Feb. 25, 2013 and entitled “Overlay-Based Asset Location andIdentification System”, the disclosures of both of which are herebyincorporated by reference in their entireties.

The network asset location system 100 also includes, in the embodimentshown, an asset management tracking engine 108. The asset managementtracking engine can, in certain embodiments, reside within a memory ofthe mobile device 102; in alternative embodiments, the asset managementtracking engine 108 can reside at a remote location from the mobiledevice 102, such as on a server 110 at a network management facility112. In such embodiments, the mobile device 102 can be configured with adata connection to the server 110, for example via a network 114 (whichcan include the Internet, as well as any of a number of different typesof wireless data networks, such as GSA, SMS, GPRS, EDGE, CDMA, WiFi,WiMax, LTE networks). In some embodiments, data and/or analysiscomponents of the asset management tracking engine 108 (as illustratedin the example shown in FIG. 2) can be stored at one or both locations(i.e., either at a server 110 or on a mobile device 102).

FIG. 2 illustrates an example logical block diagram of a network assettracking engine 108 usable within a network asset location system,according to a possible embodiment of the present disclosure. The engine108 generally analyzes image data received from a camera, and generatesdisplay information that can identify network assets, identify alocation of network assets within an image, and generate an overlayindicating such information to a user by displaying combined image dataand overlay information on the display of the mobile device 102.

In the embodiment shown, the network asset tracking engine 108 includesan asset identifier database 202, as well as an image analysis module204, a network configuration module 206, an overlay generation module208, and optionally an action log 210 and a work order listing 212.

The asset identifier database 202 stores information regarding eachnetwork asset to be tracked by the network asset location system 100. Inthe embodiment shown, example records are illustrated in the assetidentifier database; specifically, each asset can have associated withit a particular location and properties. The location can be a locationrelative to an identifier near that asset, as illustrated in furtherdetail below in connection with FIGS. 3-6. The location can also includeinformation about a particular asset location at which the asset can befound. The properties associated with the asset can include, forexample: an asset identifier, an asset description (e.g.,telecommunications jack), associated assets (e.g., a patch panel or rackin which the jack is found), and current connections through that asset(e.g., whether a particular jack has a plug inserted into that jack).Although the particular properties may vary by asset or type of asset(e.g., a jack, a panel, a rack, a router, etc.), generally the recordsin the database provide a definition of the asset and how to identify itin an image of an overall group of one or more assets that may becaptured in an image taken by a camera of a mobile device.

In certain embodiments, as discussed in further detail below,identification of the asset can correspond to an image recognitionprocess relating to both the asset and to a location identifierassociated with a group of one or more assets that uniquely define thoseassets. Examples of such an identifier are discussed in further detailbelow in connection with FIGS. 3-8.

The image analysis module 204 analyzes image data received from a cameraof the mobile device 102, and accesses information in the assetidentifier database 202 to detect identifiers in the image data anddetermine a corresponding asset identification. The image analysismodule 204 can also identify particular related assets that are requiredto be serviced if the asset identifiers are not uniquely associated withthe asset to be serviced. For example, asset identifiers may be placedon a particular networking equipment rack, but a specifictelecommunications jack on a particular panel within that rack mayrequire service. Accordingly, this related asset to the asset directlyidentified by the asset identifiers can be detected by comparison to theasset identifiers, and based on a known relative location of that assetto the asset identifiers as included in the asset identifier database202. For example, if three or more identifiers are viewable within theimage, the image analysis module could apply one or more triangulationalgorithms to determine the location of a particular network asset. Inanother embodiment, one or more features within an identifier (e.g., ifthe identifier includes one or more images) can be used to determinerelative distance, orientation, and location, using the image analysismodule. Other location-based algorithms are possible as well, forexample using WiFi triangulation or GPS techniques as discussed below.

The network configuration module 206 can optionally be included in thenetwork asset tracking engine 108, and in the embodiment showndetermines actions required to be performed by a technician. The overlaygeneration module 208 generates overlay information to be displayed withthe image data on a display of the mobile device, and can include, forexample: information identifying a particular asset; informationidentifying related assets; information identifying a particular actionto be taken by a technician (e.g. as determined by the networkconfiguration module 206), and other guidance as needed for thetechnician to service the equipment at the network asset facility (e.g.,instructions for configuring the asset). Such information can include,for example, specific steps to be taken to configure a particular assetbeing identified. For example, information can be generated for deliveryto a mobile device 102 to instruct a technician to connect or disconnecta particular plug or wire from a specific socket or connection, orstep-by-step instructions for programming a programmable panel,replacing a blown fuse or resetting a tripped circuit breaker, or otheroptions. Embodiments of the present disclosure can, based on generationof such information for display, present to a user very complex steps orinstallations that would otherwise involve consultation of referencematerials. For example, in such embodiments, a multi-step installationprocess may be guided by instructions and/or video demonstrations ofproper technique or routing information that may be involved with aninstallation.

Additionally, the overlay information can include, for example,additional details regarding operation of the particular asset. In thecase of a network asset such as a rack system or switch, informationsuch as a traffic load, power consumption, internal temperature, ormemory usage could be provided in the overlay information, as well as adisplay of memory usage, available services at the device (or aparticular port of the device). Additionally, a number of ports or jacksactively in use, or system utilization, could be displayed. Ageneralized example of such overlay information is illustrated in FIG.5.

The action log 210 stores received actions as entered by the technician,based, for example, on the technician following the guidance provided bythe overlay information displayed with the image on the mobile device.For example, the action log can store a technician-entered reportindicating movement of a telecommunications plug from a first identifiedjack to a second identified jack, based on guidance provided in theoverlay. Alternatively, the action log 210 can store information basedon other feedback mechanisms, for example based on a confirmation viathe network itself that a connectivity change has been made (e.g., bytransmitting a polling query to the newly-connected port, determiningthat additional or different endpoints can be reached based on a changednetwork configuration, or other mechanisms).

The work order listing 212 stores open work orders associated withmaintenance, repairs or reconfigurations required of a technician, andincludes identifications of particular asserts and operations to beperformed on those assets. In example embodiments, the work orderlisting 212 can include information associated with changes toparticular configurations, as well as steps to accomplish such changesin configuration. Such steps can be, as discussed below, presented to auser on a step-by-step basis.

Referring now to FIGS. 3-8, example schematic illustrations of operationof the network asset location system 100 is shown, from the perspectiveof a technician at a particular network asset location (e.g., location105 of FIG. 1).

FIG. 3 is a schematic diagram illustrating an example arrangement fortracking network assets, according to a possible embodiment of thepresent disclosure, while FIG. 4 illustrates an example display 400 ofthose network assets captured as shown in FIG. 3, as well as a depictionof triangulation to determine locations and identities of relatedassets. FIG. 5 illustrates the example display 400 including additionaloverlay information as determined using the asset management trackingengine 108.

Referring now to FIGS. 3-4, in the embodiment shown the technicianactivates a mobile application on a mobile device 102 to capture imagedata regarding a particular network asset. In this example, thetechnician is capturing video image data of a telecommunications rack300 including a plurality of patch panels 302 and associatedtelecommunications jacks 304; however, in other embodiments, other typesof telecommunications equipment can be viewed.

As briefly discussed above, a set of identifiers 306 are affixed to thetelecommunications equipment, and uniquely identify thetelecommunications equipment. In the embodiment shown, the set ofidentifiers are placed at predetermined locations on thetelecommunications rack; however, in alternative embodiments, separateidentifiers could be used for each of the patch panels 302 or othernetwork assets.

In various embodiments, the set of identifiers can uniquely identify thetelecommunications equipment that they are attached to or otherwiseassociated with in a number of ways. For example, the identifiers 306can be light emitting diodes associated with a switching controller suchthat they are configured to emit light representing a bit code thatcorresponds to an ID of the rack 300.

In alternative embodiments, the identifiers 306 can be bar codes, QRcodes, or images that are unique and associated with particulartelecommunications equipment. In other embodiments, NEF, RFID, or otherfiducial markings of known size and/or configuration could be used. Forexample, a particular image may have a known scale and orientationrelative to an asset; as such, the recognized size and orientation ofthe image can be scaled and relative position determined to derive therelative location of an asset to that image. In still other embodiments,one or more liquid crystal displays could be used as an identifier;corresponding targeting arrangements could be used in that circumstanceas well.

It is noted that, in an application associated with telecommunicationsequipment in data centers, it may be possible that low-light conditionsmake such image-based identification more difficult. In suchapplications, it may be advisable to use the above-described flashingLED configuration, or an LCD display with adjustable brightness levels.Alternatively, a constant LED flash light included with a camera of amobile device could be used to illuminate image-based identifiers.

As illustrated in particular in FIG. 4, it is noted that although theidentifiers may be associated with one particular piece of equipment(e.g., rack 300) it may be the case that a technician may need toidentify and service a particular telecommunications jack or othersubcomponent of that equipment. In such cases, a network asset trackingengine 108 stores information regarding relative locations of thesubcomponent to the identifiers, allowing the network asset trackingengine 108, and in particular the image analysis module 204, totriangulate to the subcomponent, thereby identifying the subcomponentthat is the asset.

In the embodiment shown, the display 400 of the telecommunications rackincludes a plurality of navigation buttons 402 a-d, and additionallyincludes various touch-screen functionality usable to both view andprovide information about the asset being reviewed. For example, in theembodiment shown, the navigation buttons 402 a-d include a device typebutton 402 a, an alarms button 402 b, a web interface button 402 c, anda work orders button 402 d. The navigation buttons 402 a-d can, in someembodiments, be used in conjunction with a user selecting a particularpiece of identified equipment as discussed herein (e.g., a rack, panel,or a particular connection on a panel) to identify specific informationregarding that equipment. For example, the device type button 402 aallows the user to obtain additional details about a selected asset,such as its asset label, the type of equipment, associated assets (e.g.,a network in which the asset is connected, or routing informationassociated with the asset), capacity, usage, or other information. Thealarms button 402 b can be used to either display alarms associated withthe particular asset that is selected, or to view all alarms within anetwork. The web interface button 402 c can be used to allow the user tolog in to a web interface that provides a control panel for the selectedasset, particularly in the case of a panel or rack, to allow the user toview operational parameters (e.g., workload, temperature, logs, etc.) ofthe asset.

Additionally, the work orders button 402 d can be selected to displaypending work orders, for example work orders associated with one or moreassets recognized in the image captured by the mobile device 102, orgenerally within a network configured to be tracked by the mobiledevice. Each electronic work specifies one or more steps that are to becarried out by a technician at a particular location. For example, anelectronic work order can indicate that one or more connectionsimplemented on a patch panel (e.g., panels 106 a-c above). A menudisplayed following selection of the work orders button 402 d can alsoallow the user to create a work order associated with one or more assetsof interest and identified on the display 400. In such embodiments, theuser can, for example, select first and second ports by capturing imagesof the equipment including those ports, and tapping on the ports toreceive an identification thereof from server 110. The user can thendefine one or more actions to take with respect to the equipment (e.g.,connecting a cable between specified ports of specified panels, or otheractions), which is confirmed at the server 110, which can be configuredto verify that the specified connection has been added, removed, and/orchanged correctly based on communication with the associated asset. Anexample work order definition process is illustrated in U.S. patentapplication Ser. No 13/683,866, entitled “Intelligent InfrastructureManagement User Device”, filed on Nov. 21, 2012, the disclosure of whichis hereby incorporated by reference in its entirety.

Now referring to FIGS. 5-7, various example user interfaces are shown,presented on display 400, for presenting asset and associated overlayinformation associated with a work order or device identification. Asillustrated in FIG. 5, based on the image captured and analyzed, adisplay 400 of a mobile device 102 can include not only the imageillustrated in FIG. 4, but also overlay information 500 identifying oneor more assets visible in the image, as well as information about thoseassets, such as service to be provided. In the embodiment shown, theoverlay information 500 identifies a telecommunications jack to which aplug is connected, as well as a second telecommunications jack that isintended to receive that plug. Because the identifiers 306 areassociated with the rack in which the jacks are found, each individualjack is found by triangulation to those locations, as discussed above.In the embodiment shown, the overlay information 500 includesinformation about the asset associated with the identifiers 306 (i.e.the rack 300, as shown by “Rack ID: 0001”), and also includesidentifying a location and a label for one or more sub-assets (e.g., thetelecommunications jacks 304 labeled “Port ID 24” and “Port ID 36” shownin FIG. 5). These can include, for example, CPID codes for each asset orsub-asset that is tracked. In some embodiments, the overlay information500 includes instructions for providing service to the network assets,such as by disconnecting and reconnecting network assets. Other types ofservice or operational information could be described in the overlayinformation as well, such as insertion counts, cable length, cablecategory (e.g., Category 5, Category 6, etc.) and other typesinformation such as those listed above.

Preferably, the display of both image data and overlay data is providedin realtime or near realtime with capture of the video image data. Thiswill allow the technician to move the mobile device, allow the locationsof network assets to be recomputed, and the display and overlayinformation updated as the mobile device changes position. Inalternative embodiments, the overlay information and image data can bestill image data and static overlay information. Other arrangements arepossible as well.

Referring to FIG. 6, in this example, the display 400 presents to theuser an interface including overlay information 600 that includes labelsfor the various types of identified equipment included in theillustration. In this example, an overlay label 602 can be included,either upon selection of the device type button 402 a, or in response totapping on the display in a location where the device is displayed, toshow the identity of the device, including a device type, softwareversion (if applicable, such as in the case of a managed panel),manufacturer, manufacture date, and any associated alarms. In addition,in some embodiments, other information associated with the device can bedisplayed. For example, in FIG. 7, overlay information 700 can include adetailed information area 702 that displays routing and type informationassociated with the asset being identified. For example, the detailedinformation area 702 can display information about routing from a panel,such as an identifier of another panel to which the current panel isconnected, which may not be depicted on the display 400. Additionally,various misconfigured or error-state systems can be highlighted byaccessing error reports stored at the server 110 when generating theoverlay information 702.

In some example embodiments, the additional information associated withthe asset in the detailed information area 702 can include a textual orgraphical description of a full routing arrangement including theparticular asset (e.g., a connection or panel), from a host to a switch,from a switch to a switch or router, or some other type of communicativeconnection. Such additional information can include display of currentconnections of assets, or particular predicted connections based on aplanned result of a work order. In some embodiments, the additionalinformation can be presented in the form of a text overlay, oralternatively a routing diagram allowing the user to visualize theinterconnections that are to be made.

In accordance with the display 400 shown in FIGS. 4-7, it is noted thata variety of other types of information could be presented to a user wholaps on an asset or one of the buttons 402 a-d shown on the display 400.For example, a user can tap on a particular asset that is a device todisplay warranty information associated with the device, or to getfurther information about the panel or blade, or port of such a device,by tapping on the device itself. Additionally, for technicians who wishto fulfill work orders, supplemental information can be presented to theuser as well, such as instructional videos or diagrams that illustratehop/to accomplish various routing end/or maintenance tasks.

It is also noted that, although in the embodiments described hereinspecific types of information are depicted, a user of a mobile device102 in accordance with the present disclosure can also provide feedbackfor storage in database 108, for example work order or assetidentification information. For example, a user of a mobile device 102can, in some embodiments, tap on the display to define interconnectionsbetween equipment that should be made, thereby creating one or more workorders for other technicians to execute. Additionally, options can existfor a user to select and reset one or more settings of a particulardevice via remote control through server 110 at the network managementfacility.

Referring now to FIG. 8, an alternative embodiment of an arrangement 800for tracking network assets is shown. The arrangement 800 could be usedin place of arrangement 300, but includes different types andarrangements of identifiers used in connection with specific networkassets. In particular, in the embodiment shown, each patch panel 302 hasan associated set of identifiers 802 placed on opposing sides of anarray of connectors 304, which can reduce complexity in triangulating tocalculate the position of a particular asset (e.g., a jack) whengenerating overlay information 500. In various embodiments, differentimages 802 can be used on each panel 302 (or different images can beused on opposite sides of the same panel), to assist in uniquelyidentifying a network asset. It is understood that analogous overlayinformation to that illustrated in FIG. 5 could be generated forassociation with the arrangement 800 of FIG. 8, using the images 802within the arrangement 800 to determine relative positions of assets.

In still further embodiments, one or more additional images could beplaced on the panel 302 or other assets, such that each tracked assethas an associated unique image. For example, a separate, unique imagecould be located on each panel associated with each connector 304, or incombination with an LED or bar code arrangement, to identify an asset,such that reduced triangulation calculations would be required (i.e.,each image could be placed in a predetermined or known location relativeto the asset).

Referring now to FIGS. 9-10, methods of tracking and identifying networkassets are described, using the structures and information describedabove in connection with FIGS. 1-8. FIG. 9 is a flowchart of a method900, as may be performed or implemented using software systems of amobile device, for tracking network assets using a mobile device,according to a possible embodiment of the present disclosure. Themethods and systems illustrated in FIG. 9 can be performed using any ofa number of embodiments of a network asset location system as discussedabove in connection with FIGS. 1-8.

In the embodiment shown, the method 900 begins with capture of imageinformation (e.g., still or video information) using a camera of amobile device, such as mobile device 102 (step 902). The captured imagedata is then transferred to a network asset tracking engine 108, eitherat the mobile device such as device 102, or a server 110 at a remotelocation 112 (step 904). The mobile device then receives overlayinformation, either generated locally on the mobile device or remotelyat the server 110, but in either event generated within the networkasset tracking engine 108 (step 906). A display operation generates adisplay of the image including a network asset and overlay informationhighlighting the location and identity of the network asset, as well asoptionally other information, such as identities and locations of othernetwork assets, or actions to be taken by a technician to service thenetwork asset, such as is shown in FIG. 5 (step 908).

In certain embodiments, the method 900 can include receiving feedbackfrom the technician, for example to log services or configurationsperformed by the technician. In such embodiments, a technician may inputinto the mobile device information regarding the specific servicesprovided to the network asset (step 910). In embodiments in which aremote server is used to track such technician activity, the receivedinput from the technician regarding services performed can becommunicated to the server to be logged (step 912).

FIG. 10 is a flowchart method 1000 for tracking network assets using amobile device and/or a network asset tracking engine and database remotefrom the mobile device, according to a further possible embodiment ofthe present disclosure. The methods in FIG. 10 may be performed orimplemented using software systems of a server, a mobile device, or bothsystems.

In the embodiment shown, the network asset tracking engine 108 receivesimage information captured by a mobile device (step 1002). This canoccur, for example, within the mobile device, or based on transmissionof that image data from a mobile device to a server on which the networkasset tracking engine resides. The image analysis module 204 of thenetwork asset tracking engine 108 (as shown in FIG. 2) can analyze thereceived image data, and identify one or more network assetsidentifiable within the image data, for example by decoding informationcommunicated by way of the asset identifiers associated with aparticular asset (step 1004). This can include, for example, decoding abar code or QR code, or detecting a code communicated by a strobed LED,as well as recognizing a particular image or images placed inassociation with the asset. Other configurations are possible as well.

A network asset can then be located within the image data, for examplebased on triangulation from the identifiers that are identified, andbased on information regarding relative positions of the asset andidentifiers as maintained in database 202 (step 1006). An action to betaken is determined (step 1008) for example based on pre-programmedindication of necessary service to be performed on a particular networkasset, or based on user definition of a new work order that is to becreated associated with the asset, as received from the mobile device102. Overlay information is then generated (step 1010) and provided tothe display of the mobile device (step 1012), to communicate theidentification and location of the network asset to the technician, orto communicate various other information to the technician as requiredfor interaction with the asset (e.g., warranty, error, status, orinstructional information, as explained above).

In embodiments such as those discussed above in which feedback isreceived from a technician regarding service actually performed, thenetwork asset tracking engine 108 can receive feedback information (step1014), and can store that information, for example in action log 210.

As illustrated in both FIGS. 9-10, it is noted that once overlayinformation is provided to a mobile device, the mobile device may obtainadditional image data (e.g., due to capture of video data, or asubsequent image). In such an event, the user of the mobile device mayhave changed the location of the mobile device, such as by switching itsfocus, moving the device closer to or further from the assets to beidentified, or other movements. In such instances, the presentapplication provides for continual (or periodic) updating of overlaydata as image data is received from the mobile device. As seen in FIG.9, that method could restart with a subsequent image capture (step 902)after displaying image and overlay data (step 908). In FIG. 10,additional image data could be received and processed (step 1002 etseq.) following providing overlay data from the server (step 1012). Thiscan include, for example, retargeting on a different network asset, orretargeting on the same network asset in an image having a differentfocus (e.g., with one or both of the asset or identifiers moving withinthe image).

Referring now to FIGS. 9-10 generally, in additional embodiments, othersteps, or different orders of steps, can be performed by the mobiledevice and/or server. Additionally, other devices could be used as well;for example multiple technicians can simultaneously access a serverusing different mobile devices, or multiple servers, each of which areconfigured to provide different services (e.g., managing a network assetdatabase, calculating triangulated positions of network assets based onreceived image data, or other features). Furthermore, and as discussedabove, based on various embodiments of the mobile device, the overlay ofinformation can correspond to either storage of a captured image andaddition of supplemental, guidance information to that image prior todisplay, or display of such supplemental data on a semi-transparentdisplay associated with a scene in a field of view, for example using aheads-up display or other type of display associated with a wearabledevice.

Now referring to FIGS. 11-17, additional embodiments are discussed inwhich assets can be located and managed, for example using other typesof mobile devices. In some embodiments discussed herein, the mobiledevices used according to the embodiments of FIGS. 11-17 represent handsfree, wearable display devices. In example embodiments, such devices caninclude eyewear, such as Google Glasses from Google, Inc. of MountainView, Calif., M100 Smart Glasses from Vuzix Corp. of Rochester, N.Y., orother types of overlay-based eyewear capable of displaying informationin a field of view of a wearer. As is recognized, such wearable displaydevices generally include installable applications, resident in memory,that can utilize video or image capture features of such devices as wellas wireless communication capabilities of such devices. As discussed infurther detail below, these or other types of wearable display devicescould be used as well, to provide for hands-free operation of directionsand instructions by a technician, thereby simplifying and making morereliable any maintenance performed by such technicians.

In accordance with the present disclosure, such wearable devices mayinclude other functionality that may be displayed to the user as well.For example, in some cases, a barometer may be used to detect altitude(e.g., to determine a current floor of a building where the wearer islocated), a gyroscope to determine movement, or other types offunctionalities that can generate data relevant to the user anddisplayed in the overlay.

Generally, and as referring to FIG. 11, an arrangement 1100 isillustrated in which a wearer 1103 has a wearable display device 1102,to view a field of view 1150. Within the field of view 1150, the wearer1103 views a scene 1120 that includes a plurality of objects, such asassets 1122 (e.g., racks, as shown, or any other types of assetsdiscussed above).

Generally, using the hands-free wearable display device arrangement ofFIGS. 11-17, the wearer 1103 (typically a technician) may be guided in anumber of ways to ensure that correct actions are taken. For example,and as shown in FIGS. 12-14, the wearer 1103 may be presenteddirections, such as “turn-by-turn” directions to a particular asset tobe addressed and configured. Additionally, and as shown in FIGS. 15-16,the wearer 1103 may be presented with a heads-up display presentinginstructions used to fulfill a work order received at the wearabledisplay device. An overall process is discussed in FIG. 17, below.

Referring to FIGS. 12-13, different location features are discussed.FIG. 12 illustrates an arrangement 1200 location of a wearable displaydevice 1102 and a desired asset 1122 when within a facility 1202 (e.g.,when inside a building). In this arrangement, a plurality of WiFirouters 1204 a-d are included, and the wearable display device 1102 ornetwork to which it is connected to triangulate that device's positionbased on a strength and/or directionality of signals at each device. Inthe embodiment shown, connection strength to routers 1204 a-c provides ageneral location of the device 1102, which can communicate that locationto a server 110 (or can alternatively receive a relative location of adesired asset from server 110). Based on that information, and therelative positions between the wearable display device 1102 and theasset 1122, directions can be provided. By way of contrast, and as shownin FIG. 13, in an outdoor arrangement 1300, the wearable display device1102 need not connect to or triangulate from WiFi routers 1204, butrather can directly communicate with a GPS satellite 1302.

Referring to FIGS. 14A-B, example schematic arrangements 1400, 1450 areshown in which a field of view 1402 is depicted that corresponds to thearrangements of FIGS. 11-13. In this arrangement, however, a heads-updisplay is overlaid in a region 1404 toward a periphery of a user'sfield of view. In the examples shown, the region 1404 is at a locationto an upper right of the user's field of view; however, otherarrangements are possible.

In the examples shown in FIGS. 14A-B, the region 1404 can displayvarious messages to a user. For example, in the example of FIG. 14A, theregion 1404 displays “turn by turn” directions allowing a wearer of awearable display device to navigate directly to an asset to beaddressed. Notably, this may be based on the wearable display devicecomparing a known location of an asset to a current location of thewearer, or communication of the current location of the wearer to aremote system, such as server 110, which can in turn calculate andtransmit back to the wearable display device 1102 directions for use bythe wearer 1103. In the example of FIG. 14B, a user can enter areal-time voice or video chat session with another user in region 1404,for example to receive instructions or clarification regarding a workorder to be completed, or to describe a particularcircumstance/complication in performing the work order, or reportcompletion of a work order.

Beyond the examples of FIGS. 14A-B, it is noted that other overlayinformation can be displayed in the region 1404, consistent with thetypes of information discussed herein as representing overlayinformation. For example, routing diagrams or other illustrativeinstructions or video information can be presented to allow the user tovisualize the steps to be performed in completing a work order ormaintenance task.

As seen in FIG. 15, a schematic diagram 1500 illustrating an exampleasset identification process using a wearable display device is shown.The example of FIG. 15 corresponds generally to that described above inconnection with FIG. 3, in which a camera component of a device (in thiscase, the wearable display device 1102) can identify one or more assetsor sub-assets for maintenance or technician services. This can be basedon an identification of various components, such as patch panels 1502and associated telecommunications jacks 1504.

As seen in FIG. 16, an arrangement 1600 presents within a field of view1602 a heads-up display region 1404, as discussed above. However, inthis case, the region 1404 displays step by step directions foraccomplishing the work order as prescribed.

Generally, and referring to FIGS. 11-17 generally, a method 1700 isdisclosed in which a technician wearing a wearable display device havingan application stored thereon according to the present disclosure cancause the device to receive a work order (step 1702), which includes oneor more instructions for reconfiguring networking assets.

The method 1700 includes determining a location of an asset subject to awork order, for example by accessing a location of that asset asregistered in a database (step 1704). The method 1700 also includesdetermining a location of the wearable display device (step 1706), whichcan include, for example, either using GPS or some WiFi-basedtriangulation arrangement. A comparison of those two locations can beperformed at either of the server 110 or the device 1102.

Once the comparison is performed and a difference between thoselocations computed, one or more displayable directions are presented tothe user, for example provided in a heads-up display to allow forhands-free navigation to an asset of interest. Once at that asset, thewearable display device 1102 can recognize that the asset is present(e.g., using the same types of techniques discussed above) (step 1708),and can display, in a step-by-step process, the one or more functions orsteps required to complete a work order, i.e., presenting workinstructions to the wearer 1103 (step 1710). In some cases, presentingwork instructions to the wearer 1103 can include a large number ofsteps, and can include display of scenario information, such as the endeffect of a particular work order step or overall process.

As the wearer 1103 is performing the work instructions displayed,optionally the wearable display device can also be used to captureimages and/or video of the technician's work and transmitting that backto the server, e.g., for storage in the technician action logs 210 ofthe network asset tracking engine and database 108 (steps 1712, 1714)for validation purposes.

Referring to FIGS. 1-17 generally, it is noted that the methodsdiscussed herein provide for improved reliability of network assetoperation due to a reduced probability of incorrect maintenance orconfiguration being performed. Furthermore, because in the embodimentsof FIGS. 11-17 the device used is wearable (e.g., eyewear or wristwear),such devices allow for hands-free maintenance and/or configuration, andtherefore save time by simplifying and making more natural atechnician's operations.

Further, although discussed in terms of asset location and maintenancein telecommunications networks, it is noted that the systems and methodsof the present disclosure may have applicability in other contexts inwhich work orders or other types of network management tasks arerequired. For example, various energy distribution, data communication,broadband network solutions, or other applications may be possible inwhich installation and handling of products in the field by a technicianmay similarly utilize such a system.

Additionally, and referring now to FIGS. 1-17 generally, it isrecognized that although the terms “mobile device” and “server” are usedherein, it is recognized that any of a variety of types of computingdevices could be used. Generally, the network asset tracking engine isimplemented as software modules executable on a programmable circuit,such as a microprocessor. The logical operations of the variousembodiments of the disclosure described herein are implemented as: (1) asequence of computer implemented steps, operations, or proceduresrunning on a programmable circuit within a computer, and/or (2) asequence of computer implemented steps, operations, or proceduresrunning on a programmable circuit within a directory system, database,or compiler.

Through use of the systems and methods described herein, reliableidentification of specific assets and actions required for configurationof network assets is provided, thereby reducing erroneous connections orconfigurations of networking equipment and attendant downtime due toadditional maintenance and correction of network asset configurationsthat might otherwise be required.

The above specification, examples and data provide a completedescription of the manufacture and use of the composition of theinvention. Since many embodiments of the invention can be made withoutdeparting from the spirit and scope of the invention, the inventionresides in the claims hereinafter appended.

1. A hands-free asset management system comprising: an asset trackingdatabase storing an asset location and one or more identifyingcharacteristics of each of a plurality of networking assets; anapplication executable on a wearable display device communicativelyconnected to the asset tracking database, the application executable to:receive a work order associated with at least one asset among theplurality of networking assets; based on a location of the wearabledisplay device and the work order, display one or more directions to theasset for a wearer of the wearable display device; and display one ormore work instructions to be performed on the asset.
 2. The hands-freeasset management system of claim 1, wherein the asset tracking databaseis hosted by a server remotely located from and communicativelyconnected to the wearable display device.
 3. The hands-free assetmanagement system of claim 1, wherein the wearable display deviceprovides a heads-up display at a periphery of a field of view of a userwearing the wearable display device.
 4. The hands-free asset managementsystem of claim 3, wherein the application is further executable toidentify the at least one asset to which the one or more workinstructions are to be performed on the heads-up display.
 5. Thehands-free asset management system of claim 4, wherein the applicationis executable to display a status of the identified at least one asset.6. The hands-free asset management system of claim 5, wherein the statusincludes a connection status of the identified at least one asset. 7.The hands-free asset management system of claim 1, wherein the at leastone asset is located within a building, and wherein the application usesinterior location services to identify a current location of thewearable display device relative to the at least one asset.
 8. Thehands-free asset management system of claim 1, wherein the at least oneasset is located outside of a building, and wherein the application usesa global positioning system to identify a current location of thewearable display device relative to the at least one asset.
 9. Thehands-free asset management system of claim 1, wherein the wearabledisplay device includes a camera, and wherein the application isexecutable to record one or more tasks performed on the at least oneasset by a wearer of the wearable display device.
 10. The hands-freeasset management system of claim 1, wherein the at least one asset isselected from the group consisting of: a network connectivity element; apatch panel a network switch; a subrack; a network blade; a rack system;a broadband network solution component; and an energy distributioncomponent.
 11. The hands-free asset management system of claim 1,wherein, upon receiving confirmation from a wearer of the wearabledisplay device of completion of the work instruction, communicating anupdated status of the at least one asset to the asset tracking database.12. The hands-free asset management system of claim 1, wherein, uponreceiving confirmation from the wearer of the wearable display device ofcompletion of the work instruction, communicating an updated status ofthe work order to the asset tracking database.
 13. The hands-free assetmanagement system of claim 1, further comprising the wearable displaydevice, and wherein the wearable display device comprises eyewear.
 14. Amethod of tracking networking assets, the method comprising: receiving,at an application executing on a wearable display device, a work orderassociated with at least one asset among a plurality of networkingassets stored in an asset tracking database, each of a plurality ofrecords associated with the plurality of networking assets including anasset location and one or more identifying characteristics of thatasset; based on a location of the wearable display device and the workorder, displaying one or more directions to the asset for a wearer ofthe wearable display device; and displaying one or more workinstructions to be performed on the asset based on the work order. 15.The method of claim 14, further comprising capturing image dataassociated with the one or more assets before the one or more workinstructions are performed by the wearer of the wearable display device.16. The method of claim 14, further comprising capturing image dataassociated with the one or more assets after the one or more workinstructions are performed by the wearer of the wearable display device.17. The method of claim 14, wherein displaying the one or moredirections comprises displaying turn-by-turn directions to the at leastone asset in a heads-up display window at a periphery of the wearer'sfield of vision.
 18. The method of claim 14, further comprisingtransmitting a location of the wearable display device to a serverhosting the asset tracking database, wherein the server calculates theone or more directions from the location of the wearable display deviceto the location of the at least one asset.
 19. The method of claim 14,further comprising calculating a location of the wearable display devicewithin a building using a WiFi triangulation system.
 20. The method ofclaim 19, further comprising calculating a vertical location of thewearable display device within the building using a barometer.
 21. Anapplication installable on a wearable display device for execution tomanage networking assets, the application including a plurality ofexecutable instructions stored in a memory of the wearable displaydevice which, when executed, cause the wearable display device toperform a method comprising: receiving a work order associated with atleast one asset among a plurality of networking assets stored in anasset tracking database, each of a plurality of records associated withthe plurality of networking assets including an asset location and oneor more identifying characteristics of that asset; based on a locationof the wearable display device and the work order, displaying one ormore directions to the asset for a wearer of the wearable displaydevice; and displaying one or more work instructions to be performed onthe asset based on the work order.